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The present application claims priority from U.S. Patent Application No. 
60/160,649, filed October 21, 1999, the full disclosure of which is hereby incorporated by 
reference herein. 

FIELD OF THE INVENTION 

The invention generally relates to distribution of routing information between or 
within domains of network devices. 

BACKGROUND OF THE INVENTION 

The Boarder Gateway Protocol (BGP) is a policy centered protocol that provides 
for interdomain connectivity. The ability to apply policy permits very flexible methods of 
route selection and determination. However, in accordance with BGP protocol, each 
router within a domain must have a consistent view of the network outside of its domain. 
In order to satisfy this requirement, a single domain of network devices is required to have 
complete connectivity between its various network devices. This is accomplished using 
combinations of route reflectors and meshes. BGP has added the concept of 
confederations to intradomain BGP topology. Use of confederations is discussed in 
"Autonomous System Confederations for BGP", P. Traina, IETF RFC 1965, the full 
disclosure of which is hereby incorporated by reference herein. Confederations provide 
additional hierarchy within a BGP domain. Due to the requirement for intradomain 
connectivity for BGP routers, it is difficult to scale the use of BGP to large domains. 

SUMMARY OF THE INVENTION 

In accordance with one aspect of the invention, an apparatus and method of 
distributing routing information to a plurality of network devices in a single, policy based 
domain floods such domain with policy filtered routing information. Specifically, an 
information message is received from outside the domain having routing information. A 
given policy may then be applied to the routing information in the information message. 
When policy filtered routing information is thus produced, if it is to be distributed within 
the domain, it is flooded to the plurality of network devices in the single domain. 

In preferred embodiments, policy is applied when an information message is 
received from another network device in a different domain or when an information 
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message is considered for sending to a different domain. The plurality of network devices 
may be in any arbitrary connectivity. For example, they may be in a ring connectivity. In 
some embodiments, the plurality of network devices comprises at least three network 
devices that include a given network device. The given network device is connected with 
5 no more than one other of the plurality of network devices. In other embodiments, the 
routing information is flooded by adding a link state advertisement header. The policy 
filtered routing information may include the received routing information in the 
information message. The routing information may be stored in a local data storage. The 
policies may be set by an administrator. 
10 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic diagram of network connectivity used in prior art BGP 
networks. 

Fig. 2 is a schematic diagram of network connectivity that may be used in 
accordance with embodiments of the present invention. 
15 Fig. 3 is a flow chart of actions taken in accordance with embodiments of the 

present invention. 

DESCRIPTION OF PREFERRED EMBODIMENTS 

In preferred embodiments of the invention, a policy based, inter-router protocol 
20 utilizes flooding to distribute routing information within a single domain. As known by 
those skilled in the art, a policy based protocol is a protocol that forwards and/or 
processes routing information received from another domain in a manner that is 
prescribed by a network administrator controlling the single domain. Such manner may 
be any arbitrary manner. For example, a policy may alter the costs or preferences 
25 associated with particular routes. Another type of policy may be used to preclude 

distribution within the domain of routing data from a selected third party domain. The 
policy based principles of BGP are utilized in implementing preferred embodiments of the 
invention. 

The use of BGP requires full interconnectivity between network devices within a 
30 single domain. Fig. 1 provides an illustration of a network with full intradomain 

connectivity as required by BGP. Within a single domain 20, each network device 25 
makes connection with each other network device 25 within that domain. Other 
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modifications of the intradomain topology are made possible using meshes or 
confederations. 

In accordance with an embodiment of the invention, greater flexibility in 
intradomain connectivity is possible. For example, the connectivity shown in the 
5 illustration of Fig. 2 may be used when the methods of distributing routing information of 
the embodiments of the invention are used. With these methods, it is permitted to have a 
network device 25' connected to no more than one other of the plurality of network 
devices in the domain. The methods further permit an intradomain connectivity in which 
the plurality of network devices 25 form a ring as shown in domain 20'. 

10 Referring now to Fig. 3, the distribution protocol of the embodiment of the present 

invention shall be described. A network device receives a routing information message 
100. As is known in the art, the message is identified and parsed. Routing information 
may include a route from one domain to another to get to a destination domain, capability 
information or signaling protocols such as telephone signaling protocols or multimedia 

15 signaling protocols. The action to be taken by the device receiving such a message 

depends on whether it came from one of its internal peers or an external peer 102. A peer 
is a directly connected network device. An internal peer is a network device belonging to 
the same domain as the receiving network device. An external peer is a network device in 
a different domain. Each routing information message that is received will be considered 

20 for sending to each of the other peers of the receiving network device. The actions taken 
depend on where the message is to be sent 104, 124. For a routing information message 
received from an external peer and considered for sending to an internal peer, the network 
device will apply the policies that have been set for it by the network administrator for the 
domain to which it belongs. Application of policy is performed through a policy software 

25 module 106 as is known in the art. In this manner, policies filter out some messages and 
information. This may result in the determination that such message is not for 
distribution within the domain, in which case no further action is taken with respect to 
sending the message to other internal peers. The policies may result in modifying the 
routing information message or leaving it the same, in both cases permitting distribution 

30 to the remaining internal peers. In that case, according to an embodiment of the 

invention, the filtered routing information message is flooded to all the internal peers in 
the domain. Link state software module 110 accomplishes the flooding. The filtered 
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routing information message may be the same as or a modification of the original routing 
information message. 

Flooding is a well known database synchronization method. Flooding involves 
forwarding a message to all neighboring network devices within a domain. Flooding 
5 protocols add link state advertisement headers to messages so that it can be determined if 
a message carries new or old routing information. Flooding is only possible in a policy- 
free area. Flooding is known in a variety of link state mechanisms. For example, OSPF, 
ISIS, PNNI, APPN and SCSP are all protocols that provide for link state flooding. 
However, best common practices are not to use link state mechanisms interdomain 

10 because they would not scale to interdomain level properly. The embodiment of the 
present invention provides for policy based distribution interdomain and flooding 
distribution intradomain. 

If the externally received routing information message is considered for sending to 
another external peer, policy module 1 12 applies policy. Policy can prevent the message 

15 from being sent to an external peer. Each network device is assigned zero, one or more 
policies to apply to each such message. Application of policy requires passing the 
message through the assigned policies, if any. If the message passes through the policy 
filter, it is sent to the external peer, although its contents may be modified 114. All peers, 
other than the original peer, are considered for receiving the message 116. The process is 

20 completed 118 after all such peers have received the message or been denied the message. 
Routing information messages received from internal peers will be treated in 
accordance with a flooding mechanism. As in conventional flooding mechanisms, the 
link state advertisement header is reviewed to determine whether the message is to be 
treated as a new message 120. If the message is old, it need not be processed further 122. 

25 The various link state mechanisms have ways of selecting which messages are new and 
which are old and breaking ties, if necessary. As for the internal peers 124, if the message 
is determined to be new, it is flooded to the remaining internal peers. Link state software 
module 126 accomplishes the flooding. When considering forwarding the message to an 
external peer, policy module 128 will apply policy. The message is filtered and possibly 

30 modified in accordance with the policies of the network device. If policy permits, the 
message, possibly modified, is sent with an appropriate header to the external peers 130. 
The link state advertisement header may be deleted, written over, replaced or ignored and 
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a header for the external communication may be added to the message. When all peers 
have been either forwarded the message or denied the message 132, all processing of the 
internally received message is complete 134. 

A presently preferred embodiment of a protocol for providing policy based 
5 interdomain distribution and intradomain flooding shall now be described. While this 
particular embodiment is ideally suited for routing IP multimedia signaling, embodiments 
of the invention may be adapted as well for other wide area networks. The routing 
information exchanged between network devices of the presently preferred embodiment 
includes such information as reachability of connecting destinations, the routes towards 

10 these destinations and information about gateways towards those telephony destinations 
residing in the PSTN. 

Network devices exchange sufficient routing information to construct a graph of 
domain connectivity so that routing loops may be prevented. In addition, the distribution 
protocol can be used to exchange attributes necessary to enforce policies and to select 

15 routes based on path or gateway characteristics. The present embodiment uses BGP's 
interdomain transport mechanism, BGP's peer communication, BGP's finite state machine 
and other similar formats and attributes to the BGP. Unlike BGP, however, the present 
embodiment includes intradomain flooding which therefore removes adjacency 
requirements simplifying the network device connectivity requirements within a domain. 

20 Thus, scaling the present embodiment protocol to large domains is far simpler than is the 
case for BGP with its connectivity restrictions. 

The general operation of the distribution protocol is for peer network devices to 
form a transport protocol connection between one another. They exchange messages to 
open and confirm the connection parameters and to negotiate the capabilities of each 

25 network device as well as the type of information to be advertised over this connection. 
To ensure that peers are operational keep alive messages are sent between them 
periodically. If a connection encounters an error condition, a notification message is sent 
and the connection is closed. 

Once the peer connection has been established, the initial data flow is the network 

30 device's entire internal signaling routing table. Incremental updates are sent as the 
signaling routing tables change. 

As already discussed above, the protocol distinguishes between internal and 



5 



external peers. Within a domain, link state mechanisms are used to flood database 
updates over an arbitrary topology of network devices. Externally, the protocol uses 
point-to-point peering relationships to exchange database information. Such external 
exchanges are subject to local policies. When an update is received from an internal peer, 
5 the routes and updates are checked to determine if they are newer than the version already 
in the database 120. Each link state advertisement header has a record ID uniquely 
identifying the routing information and a sequence number indicative of when the routing 
information message was created. Old messages can thus be ignored. If two messages 
are received with the same record ID and sequence number, the protocol may resort to 

10 determining the check sum for each message. This may reveal corrupt data that may be 
ignored. Other mechanisms may also be utilized to pick one of two messages having the 
same record ID and sequence number, in accordance with known link state protocols. 
Newer routing information is then flooded to all other peers in the same domain. 
Typically, each network device maintains a database for storing the routing 

1 5 information. Pointers or multiple copies of the information may be used to divide the 
information into distinct parts. One part may store the raw signaling routing information 
learned from inbound update messages. The routing information should be stored in a 
manner so that it may be accessed on the basis of which peer provided the information. 
The information should also be accessible according to routing destination addresses. A 

20 second part contains the local routing information that the network device has selected by 
applying local preferences to the raw signaling routing information. A third part stores 
information for advertisement to external peers filtered in accordance with defined 
policies. 

Each message between internal peers includes a link state advertisement header 
25 with information that properly identifies the message as a message and provides the 

length of the message. The header further includes identification of the sending network 
device. In order to facilitate flooding, update messages also include identification of the 
originator of the update, a record ID and a sequence number. The link state advertisement 
header facilitates the correct and efficient distribution of routing information among 
30 internal peers. 

The local preference attribute allows a network device in a domain to calculate a 
preference for a route and to communicate this preference to other network devices in the 
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domain. The local preference typically expresses a real world cost that is flooded 
throughout the domain to inform the internal peers that the cost exists. During route 
selection, a network device may determine its own preference for a route received from an 
intradomain network device or it may use the local preference attribute as its preference or 
it may refer to a combination of these factors to generate a preference. A network device 
must include the local preference attribute when originating a message for peer devices 
within its own domain. The network device must not include the local preference 
attribute when communicating with network devices in other domains. Local preference 
attributes received from interdomain peers must be ignored. 

The network devices may be designed to operate in terms of a finite state machine. 
The states may include an idle state, a connect state, an active state, an open/sent state, an 
open/confirm state and an established state. 

Messages from internal peers are flooded to the other internal peers. Flooding 
efficiently synchronizes the routing information databases of all the network devices 
within a domain without placing constraints on the domain's internal connectivity. The 
record ID, sequence number and originating network device identifier are used to 
determine whether the route information message is new or old. Old information is 
ignored. It is preferred for expedited flooding, but not required, that all routes received in 
a single update message that are found to be new be forwarded to all other internal peers 
in a single update message. Record ID's and sequence numbers are assigned by the 
originating network devices. A network device originates a new route and associates it 
with a record ID. For a new record ID, a sequence number that is a minimum number 
may be assigned. Each time the route is updated within the domain by the originator, the 
sequence number must be incremented. A simple method for determining whether a 
route is new is to compare sequence numbers. 

A policy module operates as in BGP to select externally received routing 
information for subsequent advertisement within a domain. The policy module is also 
utilized in determining which internally flooded routing information is to be advertised to 
an external peer. A policy may prevent dissemination of certain routing information 
within a domain or to certain external peers. A policy may instead be such as to modify 
routing information and permit dissemination of the thus filtered routing information. 
It should be noted that although a IP multimedia protocol is discussed, various 



embodiments of the invention may be implemented for specific uses such as IP telephony 
or other uses, such as with data routers. Accordingly, discussion of a IP multimedia 
signaling routing protocol is by example and not intended to limit the scope of preferred 
embodiments of the invention. 
5 Among the advantages provided by preferred embodiments is the ability to 

configure a single, policy based domain in any arbitrary topology or connectivity. For 
example, unlike current intradomain BGP connectivities, routers within a single domain 
may be connected in ways other than a full mesh or route reflector. 

Many embodiments of the invention may be implemented in any conventional 
10 computer programming language. For example, preferred embodiments may be 
implemented in a procedural programming language (e.g., "C") or an object oriented 
programming language (e.g., "C++"). Alternative embodiments of the invention may be 
implemented as preprogrammed hardware elements (e.g., application specific integrated 
circuits and digital signal processors), or other related components. 

Alternative embodiments of the invention may be implemented as a computer 
program product for use with a computer system. Such implementation may include a 
series of computer instructions fixed either on a tangible medium, such as a computer 
readable media (e.g., a diskette, CD-ROM, ROM, or fixed disk), or transmittable to a 
computer system via a modem or other interface device, such as a communications 
adapter connected to a network over a medium. The medium may be either a tangible 
medium (e.g., optical or analog communications lines) or a medium implemented with 
wireless techniques (e.g., microwave, infrared or other transmission techniques). The 
series of computer instructions preferably embodies all or part of the functionality 
previously described herein with respect to the system. Those skilled in the art should 
appreciate that such computer instructions can be written in a number of programming 
languages for use with many computer architectures or operating systems. Furthermore, 
such instructions may be stored in any memory device, such as semiconductor, magnetic, 
optical or other memory devices, and may be transmitted using any communications 
technology, such as optical, infrared, microwave, or other transmission technologies. It is 
expected that such a computer program product may be distributed as a removable 
medium with accompanying printed or electronic documentation (e.g., shrink wrapped 
software), preloaded with a computer system (e.g., on system ROM or fixed disk), or 



distributed from a server or electronic bulletin board over the network (e.g., the Internet 
108 or World Wide Web). 

Each of the following documents is hereby incorporated herein, in its entirety, by 
reference. 

5 (1) J. Rosenberg and H. Schulzrinne, "A Framework for a Gateway Location 

Protocol" IETF Internet Draft, draft-ietf-iptel-gwloc-framework-03.txt, Work in 
Progress, June 1999. 

(2) Y. Rekhter and T. Li, "A Border Gateway Protocol 4 (BGP-4)," IETF RFC 1771, 
March 1995. 

10 (3) J. Moy, "Open Shortest Path First Version 2," IETF RFC 2328, April 1998. 

(4) J. Luciani, et al., "Server Cache Synchronization Protocol (SCSP)," IETF RFC 
2334, April 1998. 

(5) International Telecommunication Union, "Visual Telephone Systems and 
Equipment for Local Area Networks which Provide a Non-Guaranteed Quality of 

15 Service," Recommendation H.323, Telecommunication Standardization Sector of 

ITU, Geneva, Switzerland, May 1996. 

(6) M. Handley, H. Schulzrinne, E. Schooler, and J. Rosenberg, "SIP: Session 
Initiation Protocol," IETF Internet Draft, draft-ietf-mmusic-sip-12.txt, Work in 
Progress, January 1999. 

20 Although various exemplary embodiments of the invention have been disclosed, it 

should be apparent to those skilled in the art that various changes and modifications can 
be made which will achieve some of the advantages of the invention without departing 
from the true scope of the invention. 
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I claim: 



1 . A method of distributing routing information through a plurality of network 
devices, the plurality of network devices being members of a single domain, each of the 
5 network devices operating in accord with given policy relating to routing information, the 
method comprising: 

receiving, from outside the domain, an information message at one of the network 
devices, the information message having routing information; 

applying the given policy of the network device that received the information 
10 message to the routing information in the information message to produce policy filtered 
routing information; and 

flooding the policy filtered routing information to each of the plurality of network 
devices. 

15 2. The method as defined by claim 1 wherein the plurality of network devices are in a 
ring connectivity. 

3. The method as defined by claim 1 wherein the plurality of network devices 
comprises at least three network devices, the at least three network devices including a 
20 given network device that is connected with no more than one other of the plurality of 
network devices. 



4. The method as defined by claim 1 wherein the act of flooding comprises adding a 
link state advertisement header to the policy filtered routing information. 

25 

5. The method as defined by claim 1 wherein the policy filtered routing information 
comprises the received routing information in the information message. 

6. The method as defined by claim 1 further comprising storing the routing 
30 information in local data storage. 

7. The method as defined by claim 1 wherein the given policy is set by an 
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administrator. 

8. An apparatus for distributing routing information to a plurality of network devices, 
the plurality of network devices being members of a first domain, each of the network 

5 devices operating in accord with given policy relating to routing information, the 
apparatus comprising: 

an input coupled with a network device in a second domain, the input receiving an 
information message from the network device in the second domain, the information 
message having routing information; 
10 a policy module coupled with the input, the policy module applying the given 

policy to the routing information in the information message to produce policy filtered 
routing information; and 

an output coupled with the policy module, the output flooding the policy filtered 
routing information to each of the plurality of network devices. 

15 

9. The apparatus as defined by claim 8 wherein the plurality of network devices are 
in a ring connectivity. 

10. The apparatus as defined by claim 8 wherein the plurality of network devices 
20 comprises at least three network devices, the at least three network devices including a 

given network device that is connected with no more than one other of the plurality of 
network devices. 

1 1 . The apparatus as defined by claim 8 further comprising a link state module for 
25 adding a link state advertisement header to the policy filtered routing information. 

12. The apparatus as defined by claim 8 wherein the policy based routing information 
comprises the received routing information in the information message. 

30 13. The apparatus as defined by claim 8 further comprising memory for storing the 
routing information. 
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14. The apparatus as defined by claim 8 wherein the given policy is set by an 
administrator. 



15. A computer program product for use in a network device in a first domain of 
5 network devices, the computer program product comprising a computer usable medium 
having computer readable program code thereon, the computer readable program code 
comprising: 

program code for receiving an information message having routing information 
from a network device in a second domain; 
10 program code for applying policy to the routing information in the information 

message to produce policy filtered routing information; and 

program code for flooding the policy filtered routing information to each peer 
network device in the first domain. 

15 16. The computer program product as defined by claim 1 5 wherein the first domain of 
network devices are in a ring connectivity. 

17. The computer program product as defined by claim 15 wherein the first domain of 
network devices comprises at least three network devices, the at least three network 
20 devices including a given network device that is connected with no more than one other of 
the plurality of network devices. 



18. The computer program product as defined by claim 1 5 wherein the program code 
for flooding comprises program code for adding a link state advertisement header to the 
25 policy filtered routing information. 



19. The computer program product as defined by claim 1 5 wherein the policy filtered 
routing information comprises the received routing information in the information 
message. 

20. The computer program product as defined by claim 1 5 further comprising program 
code for storing the routing information in local data storage. 
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21 . The computer program product as defined by claim 15 wherein the policy is set by 
an administrator. 



22. A network device in a first domain operating in accord with a given policy relating 
5 to routing information, the network device comprising: 

an input coupled with a network device in a second domain, the input receiving an 
information message from the network device in the second domain, the information 
message having routing information; 

a policy module coupled with the input, the policy module applying the given 
10 policy to the routing information in the information message to produce policy filtered 
routing information; and 

an output coupled with the policy module, the output flooding the policy filtered 
routing information to each peer network device in the first domain. 

1 5 23. The network device of claim 22 further comprising a link state module for adding 
a link state advertisement header to the policy filtered routing information. 

24. A method of distributing routing information from a network device, the network 
device being a member of a single domain and operating in accord with a given policy 
20 relating to routing information, the method comprising: 

receiving, from within the domain, an information message with a link state 
advertisement header at one of the network devices, the information message having 
routing information; 

applying the given policy of the network device that received the information 
25 message to the routing information in the information message to produce policy filtered 
routing information; and 

forwarding the policy filtered routing information to a network device in another 
domain. 



30 25. A network device in a first domain operating in accord with a given policy relating 
to routing information, the network device comprising: 

an input coupled with a network device in the first domain, the input receiving an 
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information message with a link state advertisement header from the network device in 
the first domain, the information message having routing information; 

a policy module coupled with the input, the policy module applying the given 
policy to the routing information in the information message to produce policy filtered 
5 routing information; and 

an output coupled with a network device in a second domain, the output 
forwarding the policy filtered routing information to the network device in the second 
domain. 

10 26. The network device of claim 25 further comprising a link state module for 
flooding the information message with a link state advertisement header to each peer 
network device in the first domain. 
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Abstract of the Disclosure 
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